A State Space Compression Method Based on Multivariate Analysis for Reinforcement Learning in High-Dimensional Continuous State Spaces
نویسندگان
چکیده
منابع مشابه
A State Space Compression Method Based on Multivariate Analysis for Reinforcement Learning in High-Dimensional Continuous State Spaces
SUMMARY A state space compression method based on multivariate analysis was developed and applied to reinforcement learning for high-dimensional continuous state spaces. First, useful components in the state variables of an environment are extracted and meaningless ones are removed by using multiple regression analysis. Next, the state space of the environment is compressed by using principal c...
متن کاملTree Based Discretization for Continuous State Space Reinforcement Learning
Reinforcement learning is an effective technique for learning action policies in discrete stochastic environments, but its efficiency can decay exponentially with the size of the state space. In many situations significant portions of a large state space may be irrelevant to a specific goal and can be aggregated into a few, relevant, states. The U Tree algorithm generates a tree based state dis...
متن کاملScaled free-energy based reinforcement learning for robust and efficient learning in high-dimensional state spaces
Free-energy based reinforcement learning (FERL) was proposed for learning in high-dimensional state- and action spaces, which cannot be handled by standard function approximation methods. In this study, we propose a scaled version of free-energy based reinforcement learning to achieve more robust and more efficient learning performance. The action-value function is approximated by the negative ...
متن کاملMultiagent reinforcement learning with the partly high-dimensional state space
In Multi-Agent Reinforcement Learning, each agent observe a state of other agents as a part of environment. Therefore, the state space is exponential in the number of agents and learning speed significantly decrease. Modular Q-learning [6] needs very small state space. However, the incomplete observation involves a decline in the performance. In this paper, we improve Modular Q-learning’s perfo...
متن کاملHierarchical Reinforcement Learning in Continuous State Spaces Dissertation
Reinforcement learning (RL) has been studied intensively for almost two decades. It has been attractive both for theoretical investigation because of its sound mathematical foundation, and for practical applications because of the possibility of employing a purely empirical learning. In the second half of the nineties, the theory has been given a mature formulation in a unifying view by the wor...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences
سال: 2006
ISSN: 0916-8508,1745-1337
DOI: 10.1093/ietfec/e89-a.8.2181